Robustness of speckle imaging techniques applied to horizontal imaging scenarios

Atmospheric turbulence near the ground severely limits the quality of imagery acquired over long horizontal paths. In defense, surveillance, and border security applications, there is interest in deploying man-portable, embedded systems incorporating image reconstruction methods to compensate turbulence effects. While many image reconstruction methods have been proposed, their suitability for use in man-portable embedded systems is uncertain. To be effective, these systems must operate over significant variations in turbulence conditions while subject to other variations due to operation by novice users. Systems that meet these requirements and are otherwise designed to be immune to the factors that cause variation in performance are considered robust. In addition robustness in design, the portable nature of these systems implies a preference for systems with a minimum level of computational complexity. Speckle imaging methods have recently been proposed as being well suited for use in man-portable horizontal imagers. In this work, the robustness of speckle imaging methods is established by identifying a subset of design parameters that provide immunity to the expected variations in operating conditions while minimizing the computation time necessary for image recovery. Design parameters are selected by parametric evaluation of system performance as factors external to the system are varied. The precise control necessary for such an evaluation is made possible using image sets of turbulence degraded imagery developed using a novel technique for simulating anisoplanatic image formation over long horizontal paths. System performance is statistically evaluated over multiple reconstruction using the Mean Squared Error (MSE) to evaluate reconstruction quality. In addition to more general design parameters, the relative performance the bispectrum and the Knox-Thompson phase recovery methods is also compared. As an outcome of this work it can be concluded that speckle-imaging techniques are robust to the variation in turbulence conditions and user controlled parameters expected when operating during the day over long horizontal paths. Speckle imaging systems that incorporate 15 or more image frames and 4 estimates of the object phase per reconstruction provide up to 45% reduction in MSE and 68% reduction in the deviation. In addition, Knox-Thompson phase recover method is shown to produce images in half the time required by the bispectrum. The quality of images reconstructed using Knox-Thompson and bispectrum methods are also found to be nearly identical. Finally, it is shown that certain blind image quality metrics can be used in place of the MSE to evaluate quality in field scenarios. Using blind metrics rather depending on user estimates allows for reconstruction quality that differs from the minimum MSE by as little as 1%, significantly reducing the deviation in performance due to user action

Autonomy at the end of the Earth

Despite press accounts to the contrary, significant challenges remain in the development of true autonomous vehicles. Though these challenges are many and varied my research focuses on two areas. First, operation of autonomous vehicles in inclement weather with emphasis on ice and snow. The other focus is on developing functionally safe mobility solutions. In this talk, I will briefly describe some approaches I am developing to solving these challenges.https://digitalcommons.mtu.edu/techtalks/1031/thumbnail.jp

Light Field Compression by Residual CNN Assisted JPEG

Light field (LF) imaging has gained significant attention due to its recent success in 3-dimensional (3D) displaying and rendering as well as augmented and virtual reality usage. Nonetheless, because of the two extra dimensions, LFs are much larger than conventional images. We develop a JPEG-assisted learning-based technique to reconstruct an LF from a JPEG bitstream with a bit per pixel ratio of 0.0047 on average. For compression, we keep the LF's center view and use JPEG compression with 50% quality. Our reconstruction pipeline consists of a small JPEG enhancement network (JPEG-Hance), a depth estimation network (Depth-Net), followed by view synthesizing by warping the enhanced center view. Our pipeline is significantly faster than using video compression on pseudo-sequences extracted from an LF, both in compression and decompression, while maintaining effective performance. We show that with a 1% compression time cost and 18x speedup for decompression, our methods reconstructed LFs have better structural similarity index metric (SSIM) and comparable peak signal-to-noise ratio (PSNR) compared to the state-of-the-art video compression techniques used to compress LFs

Reconstruction of long horizontal-path images under anisoplanatic conditions using multiframe blind deconvolution

All optical systems that operate in or through the atmosphere suffer from turbulence induced image blur. Both military and civilian surveillance, gun sighting, and target identification systems are interested in terrestrial imaging over very long horizontal paths, but atmospheric turbulence can blur the resulting images beyond usefulness. This work explores the mean square error (MSE) performance of a multiframe blind deconvolution (MFBD) technique applied under anisoplanatic conditions for both Gaussian and Poisson noise model assumptions. The technique is evaluated for use in reconstructing images of scenes corrupted by turbulence in long horizontal-path imaging scenarios. Performance is evaluated via the reconstruction of a common object from three sets of simulated turbulence degraded imagery representing low, moderate, and severe turbulence conditions. Each set consisted of 1000 simulated turbulence degraded images. The MSE performance of the estimator is evaluated as a function of the number of images, and the number of Zernike polynomial terms used to characterize the point spread function. A Gaussian noise model-based MFBD algorithm reconstructs objects that showed as much as 40% improvement in MSE with as few as 14 frames and 30 Zernike coefficients used in the reconstruction, despite the presence of anisoplanatism in the data. An MFBD algorithm based on the Poisson noise model required a minimum of 50 frames to achieve significant improvement over the average MSE for the data set. Reconstructed objects show as much as 38% improvement in MSE using 175 frames and 30 Zernike coefficients in the reconstruction

Calibration of the instrumental polarization effects of SCExAO-CHARIS’ spectropolarimetric mode

SCExAO at the Subaru telescope is a visible and near-infrared high-contrast imaging instrument employing extreme adaptive optics and coronagraphy. The instrument feeds the near-infrared light (JHK) to the integral field spectrograph CHARIS. Recently, a Wollaston prism was added to CHARIS’ optical path, giving CHARIS a spectropolarimetric capability that is unique among high-contrast imaging instruments. We present a comprehensive and detailed Mueller matrix model describing the instrumental polarization effects of the complete optical path, thus the telescope and instrument, using measurements with the internal source and observations of standard stars. The 22 wavelength bins of CHARIS provide a unique opportunity to investigate in detail the wavelength dependence of the instrumental polarization effects. We find that the image derotator (K-mirror) produces strongly wavelength-dependent crosstalk, in the worst case converting ~95% of the incident linear polarization to circularly polarized light that cannot be measured. We fit the crosstalk of the half-wave plate (HWP) for all wavelengths with a simple two-parameter model of an achromatic HWP consisting of a layer of quartz and a layer of MgF2. While the magnitude of the telescope-induced polarization varies with wavelength, its angle varies solely with the altitude angle of the telescope. We show initial steps toward correcting on-sky data for the instrumental polarization effects, with which we aim to achieve a polarimetric accuracy <0.1% in the degree of linear polarization. Our calibrations of CHARIS’ spectropolarimetric mode enable unique quantitative polarimetric studies of circumstellar disks and planetary and brown dwarf companions

Calibration of the instrumental polarization effects of SCExAO-CHARIS’ spectropolarimetric mode

SCExAO at the Subaru telescope is a visible and near-infrared high-contrast imaging instrument employing extreme adaptive optics and coronagraphy. The instrument feeds the near-infrared light (JHK) to the integral field spectrograph CHARIS. Recently, a Wollaston prism was added to CHARIS’ optical path, giving CHARIS a spectropolarimetric capability that is unique among high-contrast imaging instruments. We present a comprehensive and detailed Mueller matrix model describing the instrumental polarization effects of the complete optical path, thus the telescope and instrument, using measurements with the internal source and observations of standard stars. The 22 wavelength bins of CHARIS provide a unique opportunity to investigate in detail the wavelength dependence of the instrumental polarization effects. We find that the image derotator (K-mirror) produces strongly wavelength-dependent crosstalk, in the worst case converting ~95% of the incident linear polarization to circularly polarized light that cannot be measured. We fit the crosstalk of the half-wave plate (HWP) for all wavelengths with a simple two-parameter model of an achromatic HWP consisting of a layer of quartz and a layer of MgF2. While the magnitude of the telescope-induced polarization varies with wavelength, its angle varies solely with the altitude angle of the telescope. We show initial steps toward correcting on-sky data for the instrumental polarization effects, with which we aim to achieve a polarimetric accuracy <0.1% in the degree of linear polarization. Our calibrations of CHARIS’ spectropolarimetric mode enable unique quantitative polarimetric studies of circumstellar disks and planetary and brown dwarf companions

Swift X-Ray Observations of Classical Novae. II. The Super Soft Source sample

The Swift GRB satellite is an excellent facility for studying novae. Its rapid response time and sensitive X-ray detector provides an unparalleled opportunity to investigate the previously poorly sampled evolution of novae in the X-ray regime. This paper presents Swift observations of 52 Galactic/Magellanic Cloud novae. We included the XRT (0.3-10 keV) X-ray instrument count rates and the UVOT (1700-8000 Angstroms) filter photometry. Also included in the analysis are the publicly available pointed observations of 10 additional novae the X-ray archives. This is the largest X-ray sample of Galactic/Magellanic Cloud novae yet assembled and consists of 26 novae with super soft X-ray emission, 19 from Swift observations. The data set shows that the faster novae have an early hard X-ray phase that is usually missing in slower novae. The Super Soft X-ray phase occurs earlier and does not last as long in fast novae compared to slower novae. All the Swift novae with sufficient observations show that novae are highly variable with rapid variability and different periodicities. In the majority of cases, nuclear burning ceases less than 3 years after the outburst begins. Previous relationships, such as the nuclear burning duration vs. t_2 or the expansion velocity of the eject and nuclear burning duration vs. the orbital period, are shown to be poorly correlated with the full sample indicating that additional factors beyond the white dwarf mass and binary separation play important roles in the evolution of a nova outburst. Finally, we confirm two optical phenomena that are correlated with strong, soft X-ray emission which can be used to further increase the efficiency of X-ray campaigns.Comment: Accepted to ApJ Supplements. Full data for Table 2 and Figure 17 available in the electronic edition. New version of the previously posted paper since the earlier version was all set in landscape mod

Effects of THBS3, SPARC and SPP1 expression on biological behavior and survival in patients with osteosarcoma

BACKGROUND: Osteosarcoma is a very aggressive tumor with a propensity to metastasize and invade surrounding tissue. Identification of the molecular determinants of invasion and metastatic potential may guide the development of a rational strategy for devising specific therapies that target the pathways leading to osteosarcoma. METHODS: In this study, we used pathway-focused low density expression cDNA arrays to screen for candidate genes related to tumor progression. Expression patterns of the selected genes were validated by real time PCR on osteosarcoma patient tumor samples and correlated with clinical and pathological data. RESULTS: THBS3, SPARC and SPP1 were identified as genes differentially expressed in osteosarcoma. In particular, THBS3 was expressed at significantly high levels (p = 0.0001) in biopsies from patients with metastasis at diagnosis, which is a predictor of worse overall survival, event-free survival and relapse free survival at diagnosis. After chemotherapy, patients with tumors over-expressing THBS3 have worse relapse free survival. High SPARC expression was found in 51/55 (96.3%) osteosarcoma samples derived from 43 patients, and correlated with the worst event-free survival (p = 0.03) and relapse free survival (p = 0.07). Overexpression of SPP1 was found in 47 of 53 (89%) osteosarcomas correlating with better overall survival, event-free survival and relapse free survival at diagnosis. CONCLUSION: In this study three genes were identified with pattern of differential gene expression associated with a phenotypic role in metastasis and invasion. Interestingly all encode for proteins involved in extracellular remodeling suggesting potential roles in osteosarcoma progression. This is the first report on the THBS3 gene working as a stimulator of tumor progression. Higher levels of THBS3 maintain the capacity of angiogenesis. High levels of SPARC are not required for tumor progression but are necessary for tumor growth and maintenance. SPP1 is not necessary for tumor progression in osteosarcoma and may be associated with inflammatory response and bone remodeling, functioning as a good biomarker

Impaired Vascular Contractility and Aortic Wall Degeneration in Fibulin-4 Deficient Mice: Effect of Angiotensin II Type 1 (AT1) Receptor Blockade

Medial degeneration is a key feature of aneurysm disease and aortic dissection. In a murine aneurysm model we investigated the structural and functional characteristics of aortic wall degeneration in adult fibulin-4 deficient mice and the potential therapeutic role of the angiotensin (Ang) II type 1 (AT1) receptor antagonist losartan in preventing aortic media degeneration. Adult mice with 2-fold (heterozygous Fibulin-4+/R) and 4-fold (homozygous Fibulin-4R/R) reduced expression of fibulin-4 displayed the histological features of cystic media degeneration as found in patients with aneurysm or dissection, including elastin fiber fragmentation, loss of smooth muscle cells, and deposition of ground substance in the extracellular matrix of the aortic media. The aortic contractile capacity, determined by isometric force measurements, was diminished, and was associated with dysregulation of contractile genes as shown by aortic transcriptome analysis. These structural and functional alterations were accompanied by upregulation of TGF-β signaling in aortas from fibulin-4 deficient mice, as identified by genome-scaled network analysis as well as by immunohistochemical staining for phosphorylated Smad2, an intracellular mediator of TGF-β. Tissue levels of Ang II, a regulator of TGF-β signaling, were increased. Prenatal treatment with the AT1 receptor antagonist losartan, which blunts TGF-β signaling, prevented elastic fiber fragmentation in the aortic media of newborn Fibulin-4R/R mice. Postnatal losartan treatment reduced haemodynamic stress and improved lifespan of homozygous knockdown fibulin-4 animals, but did not affect aortic vessel wall structure. In conclusion, the AT1 receptor blocker losartan can prevent aortic media degeneration in a non-Marfan syndrome aneurysm mouse model. In established aortic aneurysms, losartan does not affect aortic architecture, but does improve survival. These findings may extend the potential therapeutic application of inhibitors of the renin-angiotensin system to the preventive treatment of aneurysm disease